LOCAL AUTOMORPHISMS OF THE HILBERT BALL 
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Abstract. We prove an analogue of Alexander's Theorem pQ for holomorphic map- 
pings of the unit ball in a complex Hilbert space: Every holomorphic mapping which 
takes a piece of the boundary of the unit ball into the boundary of the unit ball and 
whose differential at some point of this boundary is onto is the restriction of an auto- 
morphism of the ball. We also show that it is enough to assume that the mapping is 
only Gateaux-holomorphic. 



1. Introduction and Statement of Results 

Let M N C be the unit ball in C^, that is, 

M N = {Z e C N : \\Z\\ < 1} . 

It is well known that if H : (U,po) — > is a holmorphic mapping defined in a neigh- 
bourhood U C of some po £ dM^ which maps U n dM^ into dM^, then H is either 
a constant mapping, or it extends to an automorphism of Bjy. This Theorem is due to 
Alexander p]. 

In a Hilbert space of infinite dimension, Alexander's Theorem is not valid (see Ex- 
ample (U the author is grateful to Laszlo Lempert for pointing out this fact). However, 
if we assume in addition that the differential of the mapping H (see Theorem [1]) is onto 
at some point po on the boundeary of the ball, then the same extension property as in 
finite dimensional Hilbert space holds. That is, a mapping H defined near a point po in 
the boundary of the unit ball B C H of some complex Hilbert space H whose differential 
at p is onto extends to an automorphism of B. In order to formulate our result, we recall 
that a mapping H: U — > H defined on some open subset U C H is Gateaux-holomorphic 
if the function Z i— > (H(Z), Z) is holomorphic on all sets of the form E PI U where E 
is some finite dimensional, affine subspace of H. A Gateaux-holomorphic map H is 
holomorphic if it is also continuous (for these definitions, see e.g. the book of Dineen 
jl]). We can now state our main result. 

Theorem 1. Let H be a complex Hilbert space, P £ H with \\P\\ = I, and H : U — > H 
be a Gateaux-holomorphic map defined on a neigbourhood U of P with the property that 
\\H(Z)\\ = 1 for all Z £ U with \\Z\\ = 1, and such that the range of H'(P) is H. Then 
H is holomorphic, and furthermore, H extends to an automorphism ofB. 

Note that we do not assume any continuity of the map here; it is indeed part of the 
conclusion that the mapping H is continuous. Also note the assumption of Gateaux- 
holomorphicity implies that H has a weak (not a priori continuous) derivative, which 
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is defined on all of H; it is this derivative that we denote by H'(P) in the statement 
of Theorem [TJ It follows that H'(P)v is given by the strong limit of the difference 
quotients, 

H >( P)V= lim «(P + tv)-H(P) 

we do not assume a priori that H'(P) is bounded; similar remarks hold for higher 
derivatives. We note that the automorphisms of a ball in Hilbert space are well known 
(this goes back to a paper of Renaud [5] ) , and that any such automorphism is a linear 
fractional map (just as in the finite dimensional case) which extends holomorphically 
across the boundary of the ball. 

The proof of Theorem [I] is an application of the technique of Segre varieties on the 
Hilbert space in question. The special structure of the boundary of the ball allows us 
to do the necessary polarization very explicitly and also allows us to exploit the Riesz 
Representation Theorem (that is, the self-duality of the Hilbert space) to explicitly 
calculate expressions for H. We will do this computation in a set of different coordinates, 
which are used for computations of this type in finite dimensional complex space, the 
so-called ,, normal coordinates"; in the case of the unit ball, its boundary is put into 
normal coordinates by the well-known Cayley transform. Our calculations are very 
explicit, and also yield a good understanding of the structure of the automorphism 
group in question. 

In our proof, we will pass back and forth between applying the Segre technique along 
finite dimensional affine subspaces and using the results of these calculations to get 
global expressions for the map. It is this passing back and forth that allows us to 
establish holomorphicity of the map without assuming continuity. The technique of the 
Segre varieties has been used extensively in the study of holomorphic mappings in the 
finite-dimensional case; for a detailed discussion of their use in that case, we refer the 
reader to e.g. the survey article of Baouendi, Ebenfelt and Rothschild [3]. 

Algorithmically, our calculations follow the path along which Baouendi, Ebenfelt and 
Rothschild [2] established that automorphisms of real-analytic hypersurfaces in are 
parametrized by their jets of some finite order. Our calculations here also yield an 
explicit parametrization for the group of local automorphisms of the boundary of the 
unit ball in H; see (|2J) below. 

As noted above, the change to normal coordinates is given by means of the Cayley 
transform, which is recalled in Section [2J In these coordinates, given a point P e dB, 
B corresponds to 

H + = {(z,w): Imw > \\z\\ 2 } cCxF 1 , 
and P corresponds to (0,0). The boundary dB corresponds to 

H = { (z, w) : Imw = \\z\\ 2 } . 
Theorem [T] is a consequence of the following, more detailed Theorem: 

Theorem 2. Let F be a Hilbert space, H: U ->FxC a map defined in a neighbourhood 
U of (0,0) in F x C which is Gateaux- holomorphic on U (that is, for every affine 
subspace E of F x C, and for every continuous linear form <fi on F x C ; the map 
<j)(H): E n U -> C is holomorphic), satisfies H(0) = 0, and H{U flijcl. Assume 
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in addition that the range of H'(0) is H. Then H is holomorphic, and furthermore, if 
we denote the coordinate in F by z and the coordinate in C by w, then 

tt, ~n ( TT z + aw 9 w 
(1) H(Z) = sU — , s 2 — 

\ 1 — 2i{z, a) + (R — i \\a\\ )w 1 — 2i(z, a) + (R — i \\a\\ )w 
where U is a unitary map, s G M+, a G C, R G M, and ?7 ; s 7 a, R are given by 

u = s = v / ^(o)> 

^ V9w{0) 

.=-/. ( o)-/.(o), fi = ^w+;ii/-c)ii' . 

It is natural to ask whether or not the assumption that the range of H'(P) is necessary. 
The simplest example of a map violating this condition, which is not an automorphism 
of B was pointed out to the author by Lempert: Just consider an isometric map of H 
onto a proper subspace of itself (e.g. the shift map on £ 2 ). 

There are numerous other examples of maps whose derivative is not onto at any point 
on the boundary which are interesting; let us discuss two of them here. 

Example 1. Let H = £ 2 , and write Z = (z 1 ,z 2 - > - • ■) for the variable in £ 2 . Consider 
the set 

r = (J n k . 

fceN 

This is a countable set; choose a bijection <p : Y — > N. Let A, be a sequence with 
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For a = (ai, • • • , aifc) G T, write z a — z ai • • • z an and \a\ — k. We define H(Z) = W = 
(wi, w 2 , • • • ) by setting w^ a ) = X\ a \z a - Then H maps rB into R(r)B for < r < r for 
some r > 1, where 



2 r j . 
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It is easy to show that H is a holomorphic map; it is clearly not an automorphism. 

Example 2. Our second example generalizes the Whitney map. Using the notation 
introduced above, for a given p G N U {oo}, we now consider as an index set 

r p = |J {q}x {jeN: j >l}U{p}, p<oo, 

0<q<p 

T 00 = \J{q}x{jeN:j>l}. 

Again, we choose a bijection cf>: T p — > N and we define VU = H(Z) by 

^(<?,fc) = ^i^fc, = z\ in case p < oo. 
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Then we have that 

1 — \ y 1 2 P 

ll^)l| 2 = T3T7^(il Z ll 2 -i 01 i 2 )' p = °°- 
lil 

It is easy to check that if p 7^ 00, if extends holomorphically to a neighbourhood of B. 
On the other hand, if p — 00, H does not extend holomorphically to any neighbourhood 
of (1, 0, • • • ) (indeed, it does even extend continuously up to that point!). 

2. Changing coordinates and some observations 

We now assume that we have the following situation: if is a map defined in a 
neighbourhood U of P, satisfying the assumptions of Theorem [TJ After composing 
with a rotation in the plane spanned by P and H(P), we can assume that H(P) = P. 
We decompose H = F®CP, where F = P . In this decomposition, we write Z — (C,v) 
with C G F and rj G C. Our goal in this section is to show that Theorem [2] implies 
Theorem [TJ and to assemble the necessary prerequisites for the proof of Theorem [2] 
which will be given in the following section. 

2.1. The Cayley transform. The Cayley transform (resp. its inverse) is defined by 

, . ft .1 — ri\ tJ _ . (Hz i — w\ 

\l + 77 1 + 77/ \l + w i + wj 

and is a local biholomorphism from a neigbourhood of P to F © C, taking P to (0, 0) 
and the boundary of the unit ball (with the point —P omitted) to the hypersurface H 
in F © C defined by the equation 

hxvw = \\z\\ 2 , (z, w) G F © C. 

It also takes the interior of the unit ball to the half-space H + = {Imio > ||-2|| 2 }. 

Employing the Cayley transform, we see that Theorem [2] implies Theorem [TJ So from 
now on, we assume that H is defined in a neighbourhood of (0, 0) G F © C, takes (0, 0) 
to (0, 0), and if we write H(z, w) = (f(z, w), g(z, w)) with f(z, w) G F and g(z, w) G C, 
then we have 

1m g(z, w) = ||/(.z, w) || 2 , if Imw = \\z\\ 2 . 

2.2. Complexification. We will now complexify the last equation (in a bit of a non- 
standard manner, owing to the fact that the natural isomorphism H — > H* induced by 
the inner product is conjugate linear). We claim that we have 

(3) g(z, w) - g{x, t) = 2i{f(z, w), /(%, r)), if w - f = 2i{z, x). 

We check this claim by restricting to the finite dimensional subspace spanned by z and 
X' Choose an orthonormal basis {u, v} of the span of z and x; We have 

z = r z u + s z v, x = r x u + s x v -> 
and consider the hypersurface M in C 3 with coordinates (r, s, w) defined by 

Imw = |r| 2 + |s| 2 . 
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On this hypersurface, consider the function p defined by 

p{r, s, w) = Im g(ru + sv, w) — (f(ru + sv, w), f(z, w)), z = ru + sv. 

A fact which we are going to use often in the following is that the Banach-Steinhaus 
Theorem guarantees that a mapping which is Gateaux-holomorphic is automatically 
uniformely bounded along compact subsets of finitely dimensional affine subspaces of 
H. This in turn implies that the function p is real-analytic on a neighbourhood of in 
C 3 ; by assumption it vanishes on M; so the usual complexification shows that 



g(ru + sv, w) — g(pu + qv, r) — 2i(f(ru + sv, w), f(pu + qv , r)) if w — t = 2i(rp + sq). 

2.3. CR and transversal vector fields. Our next step is to introduce two vector 
fields which we are going to use to differentiate ([3]). We choose an u G F, and define 

(4) = 

Application of C u to a function <fi is defined in the following natural way: Suppose that 
4>(z,w,x,t) is valued in some Hilbert space E, defined in a neighbourhood of and 
that we are given z , w , Xo an d t . We choose an orthonormal basis {u,g, h} of the 
space spanned by z , Xo an d u. Setting z = ru + sg + th, and \ — au + bg + ch, we 
define C u (j)(z , wq, xo, to) to be the application of the vector field 



to <p at the appropriate point. 
We also define the vector field 



— - 2ir— 

da ' df 



dw dr 



Remark 1. Note that the Banach-Steinhaus Theorem implies that given a map h 
which is a Gateaux-holomorphic map from a Hilbert space Hi into some other Hilbert 
space H 2 , h possesses all weak directional derivatives. By this we mean the following: 
for each u G Hi and each uq in the domain of h, there exists a vector v G H 2 such that 
for all P E H 2 , 

(h(u + tu),P)-(h(u ),P} 
lim = (v,P). 

It follows by well-known arguments that this limit is actually strong, that is, 

n . h(u + tu) - h(u ) 
v = hm . 

i^O t 

In this situation, we will write v = h'(uo)(u). Note that we do not assume that h is 
differentiable when we use this notation; also, h'(uo) is not necessarily bounded. In the 
case that we are dealing with, we will write 

f z (z ,w )u = f(z ,w )(u,0), 

and so on; we will identify e.g. f w (za,wo) with the vector f w (zo, wo)(0, 1) and the 
derivatives g w (z , w ) with number g w (z , wq)(0, 1). Let us emphasize again that writing 
f z does not mean we assume that / is differentiable (that's part of what we want to 
show) . 



bernhard lamel 

3. Proof of Theorem [2] 
We now start by applying C u to (j3J). We obtain 



(5) -g z (x,r)u + 2i(u,z)g w (x,T) = 2i(f(z,w),f z (x,r)u + 2i(u,z)f T (x,r)), 

which is valid for w — f = 2i(z, x) and every u G F. Setting x = 0, r = w = and 
noting that ([3j) implies g(z, 0) = 0, we get that 



(6) g w (0)(z,u) = (f(z,0)J z (0)u + 2i(u,z)f w (0)) 

which holds for every z G F close enough by and every u G F. In particular, we have 



(7) g w (0)(u,v) = (f z (0)u,f z (0)v). 

So, if the range of H'(P) is H, this implies that / 2 (0) is an isomorphism. Furthermore, 
in that case, g w (0) = r 2 is a positive real number, and the map r~ l f z {Q) is unitary. 
Consider the automorphisms Uu iS for unitary operators U of F and sGR defined by 

uiu tS (z,w) = (sUz, s 2 w). 

Composing with the automorphism (z, w) i— > cj r fiQ\-i )r -i(z,w) = (/^(O)^ 1 ^, r~ 2 w), we 
can assume that / 2 (0) = I and ^(0) = 1. 

Returning to (jSJ), we note that we can now explicitly compute f(z, 0). Indeed, with 
the simplifications made above, we have 

(8) (z,u) = (f(z,0), u + 2i(u,z)f w (0)). 

vor z G F close by 0, and all u G F. Writing Tu = u + 2i(u, z)f w (0), we conclude that 
f(z, 0) = T*~ l z, and computing T*~ 1 v we obtain 

/(z ' 0)= 1 + ^,^(0))- 

The next simplification we can make is that we can assume f w (0) = 0. Indeed, for 
a G F, the automorphism (j) a defined by 

z + wa w 



1 — 2i(z, a) — iw \\a\\ 2 ' 1 — 2i(z, a) — iw\\a\\ 2 



takes H into itself. Composing with (j) a for a = —f w {0) we see that we can actually 
assume f w (0) = 0. 

In the next step, we first apply X to (El) to obtain 



(9) g w (z,w) -g w (x,r) = 2% ((f w (z, w), f(x, r)) + (f(z,w),f w (x,r))) 



Evaluating again at x = 0, r = w = 0, we get g w (z, 0) = ^(0). Now we apply C u to 
and evaluate at x — 0, w = r = 0. The result is 



(10) g w *(P)(z,u) = (f w (z,0),u) + (zj zw (0)u + 2i(u,z)f w 2(0)), 

from which we see that f zw (0)*z is defined for all z G F (since the equation exhibits 
that u i — ► (z, f z , w (0)u) is continuous for z close by 0). We have 



(11) /«,(«,0)=^ lfl3 (0)z-/^(0)z-(z,2i/ tt2 (0))z 
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Now turn back to (jSJ) and evaluate this equation at r = 0, w = 2i(z, x) ■ Applying our 
simplifications, it then reads 



(z,u) = g w (0)(z,u) 



/ 12 n = 9w(x^)(z,u) 

= (f(z, 2i(z, x)),u + 2i(u, z)f w ( X , 0)). 

We note that Tu = u + 2i(u, z)f w (x, 0) is a continuous, invertible linear map for z and 
X close by 0, with and compute 

T *-i,_, (v^Ux-M 

l + (z,2if w ( X ,0)) ' 

with this observation, (fT2l) implies that 

f(z,2i{z, X )) = T*- 1 z 



l + (z,2if w ( X ,0)) 



1 - 2ig w2 (0)(z, X ) + 2i(z, f zw (V)*x) ~ *(z, x)(M<>)> x) ' 

and 



9(z,2i(z,x}) 



1 - 2ig w2 (0) (z, X ) + 2i(z, fUQYx) ~ x) (fa (0) , x) ' 



We now claim that / TO a(0) = 0. To check this, we have to use Gateaux-holomorphicity 
once more. We choose a xo F an d f° r z with (z, xo) 7^ and we set w = 2i(z, Xxo), 
getting A = We also set (z, f zw (0)*xo) = a{xo)(z,Xo}- 

f{z,w) 



(13) g(z,w) 



l-(^(0)-a( Xo )V-^(A^^ 
w 



l-(g w2 (0)-a( Xo ))w-w*^^ 



Since if is Gateaux-holomorphic, the map 



is a holomorphic map C 2 —>■ C (a priori, the equation only holds on an open subset of 
C 2 , of course, but this implies that the functions coincide as rational functions). This 

2 

of course is only possible if the coefficient of 4- in the denominator does vanish, that is, 
if (/«) 2 (0), Xo) = 0. Since this holds for all xo sufficiently close by 0, we conclude that 
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f w 2(0) = 0. Thus, (|T3|) becomes 

9( z ' w ) = 1 7 77^ 7 ^ 

This holds for all (z, w) close by the origin which are of the form w = 2i{z, x) for some x 
close by the origin. Since this definitely includes an open set in each finite dimensional 
affine subspace, the principle of analytic continuation and Gateaux-holomorphicity of 
H imply that (|14p holds for all (z, w) close by the origin. At this point, we have thus 
established that H is actually holomorphic in a neighbourhood of the origin. Taking 
the second derivative with respect to w of the equation for g in (Till) , we see that 

a (Xo) = g ™ 2 ^ , so that f zw (0)u = 9w i^ u, and we conclude that 



(15) 



f(z,w) = 

w 

q(z, w) = 



where R = — 9w2 ^ . Next, let us check that H leaving EI invariant implies that R G 
We have 



(16) 



w Imw |u;| 2 (Imi?) 

Im = ■ 

1 + Rw \1 + Rw\ 2 \1 + Rw\ 2 

\\4 2 

\1 + Rw\ 2 



which implies that Imi? = 0. So, we have 5^2(0) G R. Thus, the denominator of our 
expressions for / and g does not vanish on the set H + = {Imw > ||-2|| 2 }; thus an H of 
the form above is holomorphic on all of H + . 

We will now recover the general form of a map H by retracing the simplifications 
made above. Let us write Hr for the map given by f[T5"j) . Then we have to compose 
with a map of the form (fi a and a map of the form Uu, s - This yields as the general form 
of an automorphism 

/--.rrN , TT ( TT Z + aW n W 

(17) uj U;S (f) a H R = sU- — — 2 ,s 



1 — 2i(z, a) + (R — % ||a|| )w 1 — 2i(z, a) + (R — i ||a|| )w 

We are only missing the last conclusion of Theorem [2] in order to prove this, just note 
that the particular choice of the maps made above implies that we can compute U, s, 
a and R from the derivatives of our original map H in the following way: 

fM 



.= -/.(0)-/.(0), H-^+W-W* 
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